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METHOD AND APPARATUS FOR PROVIDING A SCALABLE 
MULTI-CAMERA DISTRIBUTED VIDEO PROCESSING AND 
VISUALIZATION SURVEILLANCE SYSTEM 

nROSS-REFERENCE TO RELATED APPLICATIONS 
[0001] This application claims benefit of United States provisional patent 
application serial number 60/479,950, filed June 19, 2003, wliich is herein 
incorporated by reference. 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0002] Embodiments of the present invention generally relate to image 
processing. Specifically, the present invention provides a scalable architecture 
for providing real-time multi-camera distributed video processing and 
visualization. 

Description of the Related Art 

[0003] Security forces at complex, sensitive installations like airports, refineries, 
military bases, nuclear power plants, train and bus stations, and public facilities 
such as stadiums, shopping malls, office buildings, are often hampered by 
1970's-era security systems that do little more than show disjointed closed 
circuit TV pictures and the status of access points. A typical surveillance 
display, for example, Is 16 videos of a scene shown in a 4 by 4 grid on a 
monitor. As the magnitude and severity of threats has escalated, the need to 
respond rapidly and more effectively to more complicated and dangerous 
tactical situations has become apparent. Simply installing more cameras, 
monitors and sensors will quickly ovenwhelm the ability of security forces to 
comprehend the situation and take appropriate actions. 

[0004] The challenge is particularly daunting for sites that the Government must 
protect and defend. Merely asking personnel to be even more vigilant cannot 
reasonably guard enormous areas, ranging from amny. air and naval bases to 
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extensive stretches of border. In addition, as troops deploy, new security 
personnel (e.g.. reserves) may be utilized who are less familiar with the facility. 

[0005] Therefore, there is a need for a method and apparatus for providing a 
scalable architecture for providing real-time multi-camera distributed video 
processing and visualization that can present an alarm situation to the attention 
of a security force in a context that speeds up comprehension and response. 

SUMMARY O F THE INVENTION 

10006] In one embodiment, the present invention generally provides a scalable 
architecture for providing real-time multi-camera distributed video processing 
and visualization. An exemplary system comprises at least one video capture 
and storage system for capturing and storing a plurality of input videos, at least 
one vision based alami system for detecting and reporting alarm situations or 
events, and at least one video rendering system (e.g., a video flashlight system) 
for displaying an alarm situation in a context that speeds up comprehension and 
response. One advantage of the present architecture is that these systems are 
all scalable, such that additional sensors (e.g.. cameras, motion sensors, 
infrared sensors, chemical sensors, biological sensors, temperature sensors 
and like) can be added In large numbers without ovenwhelming the ability of 
security forces to comprehend the alarm situation. 
[0007] To illustrate, the present Invention outlines a highly scalable video 
rendering system, e.g.. the Video Flashlight™ system that Integrates key 
algorithms for remote immersive monitoring of a monitored site, area or scene 
using a blanket of video cameras. The security guard may monitor the 
monitored site or area using a live model, e.g.. a 2D or 3D model, which is 
constantly being updated from different directions using multiple video streams. 
The monitored site or area can be monitored remotely from any virtual 
viewpoint. The observer can see the entire scene from far and get a bird's eye 
view or can fly/zoom in and see activity of interest up close. In one 
embodiment, a 3D-site model is constructed of the monitored site or area and 
used as glue for combining the multiple video streams. Each video stream is 
overiaid on top of the video model using the recovered camera pose. The 



wo 2004/114648 



-3- 



PCTAJS2004/019722 



background 3D model arid the recovered 3D geometry of foreground objects is 
used to generate virtual views of the scene and the various video streams are 
overlaid on top of it. 

[0008] Coupling a vision based alarm system further enhances the surveillance 
capability of the overall system. Various alarm detection methods (e.g., 
methods that detect objects being left behind, methods that detect motion, 
methods that detect movement of objects against a preferred flow, methods that 
detect a perimeter breach, methods that count the number of objects and the 
like) can be deployed in the vision based alarm system. Upon detection of 
potential alarm situations, the vision based alami system will report the alarm 
situations where the security guard will then employ the video rendering system 
to quickly view and assess the alarm situation. 

[0009] Namely, the present invention provides tools that act as force multipliers, 
raising the effectiveness of security personnel by integrating sensor inputs, 
bringing potential threats to guards' attention, and presenting information in a 
context that speeds comprehension and response, a.nd reduces the need for 
extensive training. When security forces can understand the tactical situation 
more quickly, they are better able to focus on the threat and take the necessary 
actions to prevent an attack or reduce its consequences. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0010] So that the manner in which the above recited features of the present 
invention can be understood in detail, a more particular description of the 
invention, briefly summarized above, may be had by reference to embodiments, 
some of which are illustrated in the appended drawings. It is to be noted, 
however, that the appended drawings illustrate only typical embodiments of this 
invention and are therefore not to be considered limiting of its scope, for the 
invention may admit to other equally effective embodiments. 
[0011] Figure 1 Illustrates an overall architecture of a scalable architecture for 
providing real-time multi-camera distributed video processing and visualization 
of the present invention; 

[0012] Figure 2 illustrates a scalable system for providing real-time multi-camera 
distributed video processing and visualization of the present Invention; 
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,00,3, Figure 3 illustra.es a plurality of software modules deployed wrth,n the 
Video rendering or video flashlight system of the p-Bsent invention; 

Figure 4 illustrates a plurality of software modules deployed w^m the 
vision alert system of the present invention; 

;is, Figure 5 illustrates an lllustraBve system of the present ,nveht,on us,ng 
diaital video Streaming; and . 
io!^ Figure 6 illustrates an l,lus.ra«ve system of me present inve„t,on us,ng 

analog video streaming. 

tooin To facilitate unde^tanding, iden«oal reference numerals have been 
Led Wherever possible, to designate identical elements that sr. common to 
the figures. 

tor providing real.«me multi^mera distributed video processing and 
lallzation of the present inven«on. In one embodiment, an overall sys.m 

a Vision based alarm (VBA) system 120 and a video ..ndenng s^^em, e.g., a 

Video flashlight system 130 and a geo-locatable alam, visualizer m 

,o„,s, in operation, a plurality of inputvideos 141 .re ^ ^'"^J" 

eJideo capturestorageand Video se„ersystem110.lnoneemb^^^^^^^ 

the Inputvideos are time-stamped and stored in storage 140. The uiptnvideos 
Z also provided the vision based alarm (VBA) system 120 and the v,deo 
:endeHngsys.em130.aanetworKt.nsport143,e.g.aTCP/,Pv.eo 

transport In turn, a separate opUonal network tmhsport 145. e.g., a TCPflP 
raLetadata transport can beemployedforfo^arding and roce.^^ 

r^ and metadata information. This second networK transport — 
tbustness and provides a fault-tolerant an*itecture. However, the use of a 
:::r aZisoptional and is application spe^c.Thu. 

rplement the TCP/IP video transport and the TCP/IP alarm and metadata 

transDort as a single transport. 

I^none embodiment, the geo^ocatablealannvisualizerissoperates to 
receive alami signals, e.g.. ftom the VBAs and associated meta-data, e.g.. 
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camera coordinates, or other sensor data associated with each alarm signal. 
To illustrate, if a VBA generates an alarm signal to indicate an alarm condition, 
the alarm signal may comprise a plurality of meta data. e.g.. the type of alarm 
condition (e.g.. motion detected within a monitored area), the camera 
coordinates of one or more cameras that are currently trained on the monitored 
area, other sensor metadata (e.g.. detecting an infrared signal in the monitored 
area by an infrared sensor, detecting the opening of a door leading into the 
monitored area by a contact sensor). Using the alarm and metadata, the geo- 
locatable alarm visualizer 135 can integrate all the data and then generate a 
single view with the proper pose that will allow security personnel to quickly 
view and assess the alarm situations. For example, the geo-locatable alarm 
visualizer 135 may render annotated alarm icons, e.g.. a colored box around an 
area or an object, on the alarm visualizer display. Additionally, the geo-locatable 
alarm visualiser can be used to control the viewpoint of the Video Flashlight 
system by a mouseclick on an alarm region, or by automatic analysis of the 
alarm and metadata information. 

[0021] It should be noted that although the geo-locatable alarm visualizer 135 is 
illustrated as a separate module, it is not so limited. Namely, the geo-locatable 
alarm visualizer 1 35 can be implemented in conjunction with the VBA system or 
the video rendering system. In one embodiment disclosed below, the geo- 
locatable alarm visualizer 135 is implemented in conjunction with the video 
rendering system 130. 

[00221 Effective video security and surveillance applications of the present 
invention need to handle hundreds and thousands of cameras with real-time 
intelligent processing, alarm and contextual video visualization, storage and 
archiving functions integrated in a system. The present invention is a scaleable 
real-time processing system that is unique in the sense that tens to hundreds to 
thousands of videos are continuously captured, stored, analyzed and processed 
in real-time, alerts and alarms are generated with no latency, and alarms and 
videos can be visualized with an integrated display of videos and 3D models 
and 2D iconized maps. The display management of thousands of cameras Is 
managed by the use of a video switcher that selects which camera feeds to 
display at any one time, given the pose of the required viewpoint and the pose 
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Tzone and so on. These detected obiects can be highl.ghted on «,e 3D n«^e^ 
Tld as a cue to the operator to direct his viewpoint. The system can also 

„:T;ue2i,lustratesascalab,esvsten,200ofthep.sentlnven.on,or 

oZin real-time multi-camera distributed video processing and v^uai^ton. 
s"2ly^igure21,lustratesanexempla^— eimpien,entat»no,*e 

pritrsiem However, since Figure 2 is only prodded as an e«mp 
Z nJt be interpreted to lim« the present Invention in any way becau^ 
r different hardware implementations are possible In view of the p,.sent 
disdosur. or in response to different application 

,„„.s, The scalable system 200 comprises at least one v,dao -P*"- ^"-se ^ 

L Ideo server system 110, a vision based alam, (VBA) ^-"^ ^^ l''^ 
,easto„a Video rendering system, e.g..av.deo«ashllgMsJemo^PC^^^^^^ 

Plurality of sensors, e.g., fixed cameras, pan tltt and zoom (F^Z) cameras, or 
risers 205, various networK related components such as adapters and 

switches and input/output devices 250 such as monrtors. 
: rone eldlment, .e Video capture storage and video ..e^^^^^ 

110 comprises a video distributon ampiffier 212, one or mor. QUAD p«>cessors 
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214 and a digital video recorder (DVR) 216. In operation, video signals from 
cameras, e.g., fixed cameras and PTZ cameras are amplified by the video 
distribution amplifier 212 to ensure robustness of the video signal and to provide 
multiple distribution capability. In one embodiment, up to 32 video signals can 
be received and amplified, where up to 32 video signals can be distributed to 
the video flashlight PC and to the VBA PC 120 simultaneously. 
[0027] In turn, the amplified signals are forwarded to QUAD processors 214 
where the 32 video signals are reduced to 8 video signals. In one embodiment, 
four signals are reduced to one video signal, where the resulting signal may be 
a video signal having a lower resolution. In turn, the 8 signals are received and 
recorded by the DVR 216. It should be noted that the videos to the DVR 216 
can be recorded and/or simply passes through the DVR to the video flashlight 
PC 130. 

[0028] It should be noted that the use of the QUAD processors and the DVR is 
application specific and should not be deemed as a limitation to the present 
invention. For example, if a system is totally digital, then the QUAD processors 
and the DVR can be omitted altogether. In other words. If the video stream is 
already in digital format, then it can be directed red to the video flashlight PC 
130. 

[0029] The video flashlight PC 130 comprises a processor 234, a memory 236 
and various input/output devices 232, e.g., video capture cards, USB port, 
network RJ45 port, serial port and the like. The video flashlight PC 130 
receives the various video signals and is able to render one or more of the input 
videos over a model, e.g., a 2D or a 3D model of a monitor area. Thus, a user 
is provided by a real time view of a monitored area. Examples of a video 
rendering system or video flashlight system capable of applying a plurality of 
videos over a 2D and 3D model are disclosed in US patent applications entitled 
"Method and Apparatus For Providing Immersive Surveillance" with serial 
number 10/202,546, filed 7/24/02 with docket SAR 14626 and entitled "Method 
and Apparatus For Placing Sensors Using 3D Models" with serial number 
10/779,444, filed 2/13/04 with docket SAR 14953, which are both herein 
incorporated by reference. 
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X. • nn .l.rt PC or VBA 130 comprises a processor 224. a memory 
[0030] The v.s.on alert PC o VBA P ^,,3, ,3pt,re cards. Modular 

226 and various input/output devices 222. e.g.. vioeo o<ih 

preferred flow, .e*ods *at detect a perimeter breach, 
L.ero.o.ec.sand*e.e,T.esp«.ode^^^^^^^ 

::r::r:;:::— ^^^^^^ 

XLed for ex. only may be an alar,. cond^on, detect,r,g en^ of an 
n rirKina hours .ay be an a,an. oond.on, detecting a sta^ona-^ 
:;Caterthanaspac,f.d.irnedura«onwl.h.^ 

:::pret:r:poten«aU,a.s„ua«ons,.ev:s.nba^^^^^ 
:i;owi,ueportthea,a™situa«ons,e.gioggln«thee^^^^^^^^ 
and/orforwa^ing an alarn. Signal tothevideoflash,,gWPCm^^^^^^ 
security guard wiil then employ the video .^ndenng system to qu,cWy v,ew 
assess the alarm situation. -.u nVR 216 the 

,03. Thus, a network sw^h 246 is in communicat,on w,th ^J>'^^^;^ 
. ur M pr 1 10 and the vision based alami system 1 20. This allows 

rprr— ./analam,cond,..ns 
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the Video flashlight PC. one can also see the full resolution videos as captured 
the cameras as well. 

[0034] In one embodiment, various sensors 205 are optionally deployed. These 
sensors may comprise motion sensors, infrared sensors, chemical sensors, 
biological sensors, temperature sensors and like. These sensors are in 
communications with MIO cards on the vision alert PC 120. These additional 
sensors provide additional information or confirmation of an alarm condition 
detected by the vision alert PC 1 20. 

[0035] Finally, an optional uninterruptible power supply (UPS) Is also deployed. 
This additional device Is intended to provide robustness to the overall system, 
where the loss of power will not Intermpt the security function provided by the 
present surveillance system. 

[0036] Figure 3 illustrates a plurality of software modules deployed within the 
video rendering system or video flashlight PC 130. The video flashlight PC 130 
employs three software modules or applications: a 3-D video viewer or 
rendering application 310, a system monitor application 320. and an alamn 
visualizer application 330. Although the present invention is described 
illustratively with various software modules or sub-modules, the present 
invention Is not so limited. Namely, the functions performed by these modules 
can be deployed in any number of modules depending on specific 
implementation requirements. 

[0037] The 3-D video viewer or rendering application 310 comprises a plurality 
of software components or sub-modules: a video capture component 312, a 
rendering engine component 313, a 3-D viewer (GUI) 314. a command receiver 
component 315, a DVR control component 316. a PTZ control component 317. 
and a matrix switcher component 318. In operation, videos are received and 
captured by the video capture component 312. In addition to Its capturing 
function, the video capture component 312 also time stamps the videos for 
synchronization purposes. Namely, since the module operates on a plurality of 
video streams, e.g.. applying a plurality of video streams over a 3-D model, it is 
necessary to synchronized them for processing. 

[00381 The rendering engine 313 is the engine that overiays a plurality of video 
streams over a model. Generally, the model is a 3-D model. However, there 
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be Situations where a 2-0 or adaptive 3D mode, can be app ed s - 
Spending on the application. The 2-0 ™de, can be a plan iayout of a .id,ng, 
foLmpie Video is shown in the vicintty of ^ camera locatK>n, and not 
irioveda. on the mode,, intheadap^ve 3D mode,. v.eo is Shown 

0 a« on the 3D mode, when the viewer views the scene f.m a .ew.ng 
argror^sethatissimiiarto that ofthe camera, but is Shown in the^^^^^^^^^^^ 

Te t mera location . the viewing angie or pose is very dissimilar to that o, the 

::rThe3-Dviewer(GU,)314servesas«,egraphicaU,seri,,teJ^e.^ 
Joiofvariousviewingfunctions. To ,,,us.rate, the 3-0 v,ewer (G ) M 
controls what videos wiii be captured by the ,.deo capture component 312 F 
Txt e if *e user provides input indicaSve of a viewing preference po, ..ng jn 
;:Llydi.ct.n,thenvideos,romthewester,ydirec«ona.not.pt^^^ 

10040, Additionally, the 3-D viewer (GUI) 314 controls what pose ™« be 
endered by the rendeHng engine 313 by fon^arding pose 

pose values) to the rendering engirt 313. The 3-D viewer (GUI) 314 also 
ILls the DVR216andPTZcame.s 205 Via the DVRcontrol component 

Cd the PTZcontmlcomponent317.respec«valy.Name,y.the user ..n 

let a recorded video stream in the DVR via the DVR -po^"^6 
and control the pan, tilt and zoom WionsofaPTZ earner.,^ t^^^P^-'ro. 

oomponent317. Porexample,ausercancilcKonthe^D^d. .g^x^ 

coordinates) and the proper PTZ values will be generated, e.g., by a PTZ pose 
generation module and senttothe relevant PTZ^^^^^^^^^^ 
.00411 The commands receh/er component 31 5 serves as a p 
isu lizer appl,ca«on 330, where a user clicking on the alami browser 332 w,ll 
irthermmandsreceK,erc«mponent315toWe,actw,.h«,e.ndenng 

Tg^e component 313 to display «ie p^per view. Additiona„y. . neoess^. 
le commands receiver component 31 5 may also obtain one or more^ored 
Video streams ,n the DVR to generate the desired view an dder alarm 
condition is being recalled and viewed. ,...^i,^K„ 
[0042, Fina„y. the 3-0 ^ewer (GU,) 314 interacts with the matnx swrtoher 
Ilcominent318*>obtainfullreso,u«on videos. Name,, the user can 

obtain the fu„ reso,ution v,deo from a camera output direcUy. 



wo 2004/114648 



-11 - 



PCT/DS2004/019722 



[0043] The alarm visualizer application 330 comprises a plurality of software 
components or sub-modules: an alarm browser (GUI) 332. an alarm status 
storage update engine component 334. an alarm status receiver component 
336. an alarm status processor component 338 and an alarm status display 
engine component 339. The alarm browser (GUI) 332 serves as a graphical 
user interface to allow the user to select the viewing of various potential alarm 
conditions. 

10044] The alarm status receiver component 336 receives status for an alarm 
condition, e.g.. as received by a VBA system or from an alarm database. The 
alarm status processor component 338 serves to mark whether an alarm is 
acknowledged and cleared or responded and so on. In tum, alarm status 
display engine component 339 will display the alarm conditions, e.g.. in a color 
scheme where acknowledged alarm conditions are shown in a green color and 
unacknowledged alarm conditions are shown in a red color and so on. Finally, 
the. alarm status storage update engine 334 is tasked with updating a system 
alarms database 340. e.g.. updating the status of alami conditions that have 
been acknowledged or responded. The alami status storage update engine 
334 may also update the alarm status on the vision alert PC as well. 
[0045] In one embodiment, the system alarms database 340 is distributed 
among all the vision alert PCs 120. The system alarms database 340 may 
contain various alarm condition information, e.g.. which vision alert PC reported 
an alarm condition, the type of alamri condition reported, the time and date of 
the alarm condition, health of any PCs within the system, and so on. 
[0046] The system monitor application 320 comprises a plurality of software 
components or sub-modules: a system monitor (GUI) 322. a health status 
information receiver component 324. a health status information processor 
component 326 and a health status alarms storage engine component 328. In 
operation, the system monitor (GUI) 322 serves as a graphical user interface to 
monitor the health of a plurality of vision alert PCs 120. For example, the user 
can click on a particular vision alert PC to detennlne.its health. 
[0047] The health status Infonmation receiver component 324 operates to ping 
the vision alert PCs. e.g.. periodically to determine whether the vision alert PCs 
are in good health, e.g.. whether it is operating normally and so on. If an error 
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is detected, the health status information receiver component 324 reports an 
error for the pertinent vision alert PC. 

10048] in turn, the health status information processor component 326 is tasked 
with making a decision on the status of the error. For example, it can simply log 
the error via the health status alami storage engine 328 and/or trigger various 
functions, e.g., direct the attention of the user that a vision alert PC is off line, 
schedule a maintenance request, and so on. 

[0049] Finally, the video flashlight system 130 also employs a time synch 
module 342, e.g., a TARDIS time synch server. The purpose of this module .s 
to ensure that all components wrthin the overall system have the same time. 
Namely, the video flashlight PC and the vision alert PC must be time 
synchronized. This time consistency serves to ensure that alami conditions are 
properly reported in time and that time stamped videos are properly stored and 
retrieved. 

[0050] Figure 4 illustrates a plurality of software modules deployed within the 
vision alert system 120 of the present invention. The vision alert system 120 
employs a vision alert application 410 that comprises a video capture 
component 41 1 . a video alamis processing engine component 412, a 
configuration (GUI) 413. a processing (GUI) 414. a system health monitoring 
engine component 41 5. a video alarms presentation engine component 416. a 
video alarms information storage engine component 417 and a video alarms 
AVI storage engine component 41 8. 

[0051] in operation, videos are received and captured by the video capture 
component 412. In addition to its capturing function, the video capture 
component 412 also time stamps the videos for synchronization purposes. 
[00521 The video alarms processing engine component 41 2 is the module that 
employs one or more alarm detection methods that detect the alami conditions. 
Namely, alarm detection methods such as methods that detect objects being 
left behind, methods that detect motion, methods that detect movement of 
objects against a preferred flow, methods that detect a perimeter breach, 
methods that count the number of objects and the like can be deployed m the 
video alarms processing engine component 412. The methods that will be 
selected and/or the thresholds set for each alarm detection method can be 
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configured using the configuration (GUI) component 41 3. In fact, configuration 
of wilich videos will be captured is also controlled by the configuration (GUI) 
component 413 as well. 

[0053] The vision alert PC 120 employs one or more network transport, e.g.. 
HTPP and ODBC channels for communications with other devices, e.g., the 
video flashlight system 130. a distributed database and so on. Thus, the 
system health monitoring engine component 41 5 serves to monitor the overall 
health of the vision alert PC and to respond to pinging from the system monitor 
application 320 via a network channel. For example, if the system health 
monitoring engine component 41 5 determines that one or more of its functions 
have failed, then it may report it as an alarm condition on the alarms information 
database 422. 

[00541 The video alarms presentation engine component 416 serves to present 
an alarm condition over a network channel, e.g.. via an IIS web server 420. The 
alarm condition can be fonvarded to a video flashlight system 130. Additionally, 
the detection of an alarm condition will also cause the video alarms information 
storage engine 417 to log the alarm condition in the alarm Information database 
422. Additionally, the video alarms AVI storage engine 418 will also store a clip 
of the pertinent videos associated with the detected alarm condition on the AVI 
storage file 424 so that it can be retrieved later upon request. 
[0055] In one embodiment, the processing (GUI) component can be accessed to 
retrieve the stored video clips that is stored in the AVI storage file. The 
forwarding of the stored video clip can be implemented manually, e.g., upon 
request by a user clicking on the alarm browser 332, or perfonned 
automatically, where certain types of important alami conditions (e.g., perimeter 
breach) are such that the video clips are delivered automatically to the video 
flashlight system for viewing. 

[00561 Finally, the video flashlight system 120 also employs a time synch 
module 426, e.g., a TARDIS time synch server. The purpose of this module is 
to ensure that all components within the overall system have the same time. 
Namely, the video flashlight PC and the vision alert PC must be time 
synchronized. This time consistency seives to ensure that alamn conditions are 
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properly reported in «me and that «ma stamped videos ^^ property stored and 

r^ria CORBA is a 3" party networks comnvinioations program on top of 
Which we have buiit fanctions that we use for sending real-time tracing 
Dositions, PTZ pose information across the network. 

F^u,« 5 .ustrates an illustrative system 500 of the present ,nven.on 
Z lii Video streaming, whereas Figure 6 illustrates an ilius,rat,ve system 
rofthepresentinven«onusinganalog.deostreaming. These illus^^^^^^ 

systems are examples of *e general scalable architecture as isclo^ 
Namely the present archftecture allows a system to easily scale up the number 
!;se ors,vLocapture/compresssta«ons,.s.n based alerts^^^^^^^^^ 

Video rendering stations (e.g., video flashlight rendering systems or de*<.^d 
alam, rendenng systems). Namely, the present invention P--- ^^^^^^ 
as force multipliers, raising the effect^eness of security personnel by mteg^ng 
sensor inputs, bringing potential threaU .0 guards' attention, and present.g 
intormatton in a context that speeds comprehension and respons , and ^uces 
the need for extensive twining. When security fo,^ can -ders an^e 
tactical Situation more quickly, they a,* better able to focus on the threat^d 
take «,e necessary actions to prevent an attack or ..duce «s consequences. 
,0059] It should be understood that the various modules, componente or 
'I^Uns as discussed above can be implemented as a physical de.ce or 
subsystem that is coupled to a CPU through a communication channel. 
Altel«vely. these modules, components or applications can be represented 
C one or more software applications (or even a combina«on of software and 
hardware, e.g., using app«on speCc integrated ..ul^ » ^ ^ 
software is loaded from a storage medium (e.g.. a magnefc oroptca dnve or 
diskette) and operated by the CPU in the memory of the computer^ As such, 
these modules, components or appllcatons (Including assocated da^ 
stmcturBS) of the present inventton can be stored on a computer readable 
Itmorcar.ere.g..RAMmemo^,magne«coropt,c.driveordlske«eand 

llT/^though the present Invention is disclosed within the context of a vision 
alert system, various embodiments of video rendering can be implemented that 
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are not in response to an alarm condition. For example, it is possible to deploy 
a very large number of cameras along a perimeter such that the video flashlight 
system is configured to provide a continuous real time "bird's eye view", 
"walking view" or more generically "virtual tour view" of the perimeter of a 
monitored area. For example, this configuration is equivalent to a bird flying 
along the perimeter of the monitored area and looking down. As such, as the 
view passes from one portion of the perimeter to another portion, the video 
flashlight system will automatically access the relevant videos from the relevant 
cameras (e.g.. a subset of a total number of available videos) to overlay onto 
the model while ignoring other videos from other cameras. In other words, the 
subset of videos will be updated continuously as the view shifts continuously. 
Thus, it is possible to greatly increase the number of cameras without 
overwhelming the attention of the security staff. 

[00611 While the foregoing is directed to embodiments of the present invention, 
other and further embodiments of the invention may be devised without 
departing from the basic scope thereof, and the scope thereof is determined by 
the claims that follow. 
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Claims: 

1 . A method for monitoring at least one scene, comprising: 
receiving a plurality of input videos: and 

applying selectively a subset of said plurality of input videos to a model of 
the at least one scene in response to a pose parameter. 

2. The method of claim 1 . wherein said pose parameter is selected in 
accordance with an alarm signal. 

3. The method of claim 2. wherein said alarm signal is generated by an 
alarm detection method. 

4 The method of claim 1 . further comprising: 

receiving signals from at least one sensor deployed within the at least one 

scene. 

5 The method of claim 2. further comprising: 

Nghlighting a portion of the at least one scene to indicate a location associate 
with said alarm signal. 

6 . The method of daiml, wherein said subset of said plurality of input 
vMeos is continuously updated to provide a continuous virtual view of the at 

least one scene. 

7 The method of claim 1 , wherein said plurality of input videos are provided 
by a plurality of cameras, wherein at least one of said cameras has pan. tilt and 
zoom (PTZ) capability. 

8. The method of claim 1 . wherein said subset of said plurality of input 
videos is overiaid over said model. 
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9. An apparatus for monitoring at least one scene, comprising: 

a plurality of cameras for providing a plurality of input videos; and 
a video rendering system for applying selectively a subset of said 

plurality of input videos to a model of the at least one scene in response to a 

pose parameter. 

1 0. The apparatus of claim 9, further comprising at least one vision based 
alarm system for generating an alarm signal, wherein said pose parameter is 
selected in accordance with said alarm signal. 
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